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ABSTRACT 



In May 2000, the Office of Research and Planning at Nova 
Southeastern University, Florida, examined student outcomes for courses 
taught in Internet-based and campus-based formats and found statistically 
significant differences in student outcomes for courses offered in both 
modalities. One finding was that graduate students of the Wayne Huizenga 
Graduate School of Business and Entrepreneurship in Internet-based sections 
outperformed those in campus-based sections. The purpose of this study was to 
determine if specific courses caused the observed difference or if the 
findings were the result of a more general trend for all courses. Three 
courses were evaluated: (1) Twenty- first Century Management; (2) the Legal, 

Ethical, and Social Values of Business; and (3) Delivering Superior Customer 
Value. A total of 468 students were considered, of whom 119 were in 
Internet-based courses and 349 in campus-based sections. Overall, the 
students had high rates of success and completion (94%) . While examination of 
final grades revealed that students performed well in courses offered in both 
formats, mean final grades of students in Internet-based and campus-based 
sections differed at a statistically significant level in two courses. When 
course completion rates for students in Internet-based courses at this 
business school were compared with those of students from other institutions 
(S. Carr, 2000), it was found that course completion rates were generally 
lower for students in Internet-based courses, but at Nova Southeastern 
University, there was no difference in course completion rates for the 
courses studied. An appendix contains data for the sections studied. (SLD) 
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EXECUTIVE SUMMARY 

In May of 2000, the Office of Research and Planning examined student outcomes in courses 
taught in both Internet-based and campus-based formats and found that there were substantial 
differences in student outcomes for courses offered in both modalities (Fredda, 2000). One 
finding was that graduate students of the Wayne Huizenga Graduate School of Business and 
Entrepreneurship in Internet-based sections out-performed those in campus-based sections. The 
purpose of this report is to determine if specific courses caused this observed difference or if the 
findings were due to a more general trend for all courses. 

Three courses were evaluated, Twenty-first Century Management, The Legal, Ethical, and Social 
Values of Business, and Delivering Superior Customer Value, with 468 total students. One 
hundred and nineteen students were in Internet-based sections and 349 were in campus-based 
sections. Overall, graduate students had high rates of success and completion (94 percent). While 
examination of final grades revealed that graduate students performed well in courses offered in 
both formats, mean final grades of students in Internet-based and campus-based sections differed 
at a statistically significant level in two courses. 

It is helpful to compare course completion rates for students in Internet-based courses in the 
Wayne Huizenga Graduate School of Business and Entrepreneurship with other institutions. 
According to Carr (2000), course completion rates for distance education based courses has been 
a concern for many institutions. Whereas Carr reported 10 to 20 percent higher course 
completion rates for students in traditional sections, at Nova Southeastern University there was 
no difference in course completion rates for the courses studied. 
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INTRODUCTION 



In May of 2000, the Office of Research and Planning examined student outcomes in courses 
taught in both Internet-based and campus-based formats and found that there were substantial 
differences in student outcomes for courses offered in both modalities (Fredda, 2000). One 
finding was that graduate students of the Wayne Huizenga Graduate School of Business and 
Entrepreneurship in Internet-based sections outperformed those in campus-based sections. The 
purpose of this report is to determine if specific courses caused this observed difference or if the 
findings were due to a more general trend for all courses by answering the following question: 

Are there substantial differences between graduate student outcomes in specific Internet- 
based and campus-based courses offered in the Wayne Huizenga Graduate School of 
Business and Entrepreneurship? 



METHODOLOGY 



Course Sections 



Twelve graduate courses were offered in both Internet-based and campus-based formats at the 
Wayne Huizenga Graduate School of Business and Entrepreneurship during the Fall Term of 
1999. Three of the 12 courses met the criteria of an enrollment of at least 100 students and were 
included in the study, Twenty-first Century Management, The Legal, Ethical, and Social Values 
of Business, and Delivering Superior Customer Service. Twenty-three sections of the three 
courses were offered; ten sections were Internet-based and 13 were campus-based. 

Participants 

Four hundred and sixty-eight graduate students were enrolled in all of the sections studied. One 
hundred and nineteen students were enrolled in Internet-based sections, 349 were enrolled in 
campus-based sections. For a listing of student enrollments and section numbers by course refer 
to Appendix A, Table la. 

Operational Definitions 

• Internet-based - sections that were offered electronically via the Internet. Internet-based 
course content is similar to that in courses offered in the campus-based lecture format, only 
the modality through which information is shared is different. Students enrolled in Internet- 
based sections engaged in the following activities: 

1 . Received lectures offered in PowerPoint, video, and/or audio format 

2. Accessed library information (including full text articles) 

3 . Completed coursework 

4. Received professor feedback 

5. Discussed pertinent topics in real time with fellow students and faculty 
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• Campus-based - Traditional lecture-based sections that were offered at Nova Southeastern 
University’s Davie and Ft. Lauderdale facilities. 

Grades 

While standard final grades (A, B, C, etc) were included in this study, less common grades were 

included as well. These were defined as: 

• No grade/blank - Faculty failed to record a final grade in Nova Southeastern University’s 
Banner Student Information System. 

• /-Incomplete 

• WU - Administrative withdrawal 

• W- Student withdrawal 

Dependent Variables 

To understand potential differences between Internet-based and campus-based formats, graduate 

student outcomes were evaluated on two dimensions, successful grades and course completions. 

1. Successful grades - successful grades included A, A-, B+, B, B-, C+, C, and C-. All other 
grades were categorized as unsuccessful. 

2. Completion -final grades of no grade/blank, I, WU, and W were categorized as incomplete, 
all other grades were categorized as complete. 

Procedure 



In July of 2000, final grades were obtained through multiple queries to Nova Southeastern 
University’s Banner Student Information System and used for analysis by the statistical program 
SPSS, version 10.0. Letter grades were recoded into the numeric equivalent used by Nova 
Southeastern University’s Banner Student Information System (i.e. A = 4.0, A- = 3.7, B+ = 3.3, 
etc.) for analysis. 

One-way Analysis of Variance (ANOVA) tests were used to analyze student outcomes. Analysis 
of variance tests are used to determine if group values are equal by evaluating group means and 
standard deviations. Student outcomes for those that completed a given course were analyzed by 
a one-way ANOVA to determine if there was a statistically significant difference between final 
grades for students in Internet-based versus campus-based sections. 

Chi-square tests were also used to analyze student outcomes. Chi-square tests compare different 
levels of a categorical variable on the rate of values for a second variable to determine if the 
same proportion of the second variable’s values occurred in each category of the original 
variable. For the present study, Chi-square tests were used to determine if there were equivalent 
rates of successful grades (i.e. A’s, B’s, etc.) and completion for students in Internet-based and 
campus-based courses. For all statistical analyses an alpha level of 0.10 was used to determine 
significance. 



RESULTS 



Twenty-first Century Management 

The results of a one-way ANOVA revealed there was not a statistically significant difference (2 
= 0.67) between final grades of Internet-based and campus-based students in Twenty- first 
Century Management that completed the course. Students in Internet-based and campus-based 
sections had similar final grades (means of 3.68 and 3.71, respectively). For a distribution of 
final grades for graduate students in Twenty-first Century Management refer to Appendix A, 
Table 2a and Figure la. 

Success and Completion Rates 

Graduate students in Internet-based and campus-based sections of Twenty-first Century 
Management had comparable rates of success and completion (Figure 1). Ninety-three percent of 
graduate students in Internet-based sections and 95 percent of students in campus-based sections 
were successful and completed the course (Table 1). A Chi-square test revealed these differences 
were not statistically significant (p = 0.66). 



Figure 1. Success and Completion Rates for Graduate Students in Internet-based versus 
Campus-based Sections of Twenty-first Century Management. 
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Table 1. Rates of Successful Grades and Completion for Graduate Students in Internet- 
based and Campus-based Sections of Twenty-first Century Management. 



Format 




Internet-based Campus-based 


Total 



Successful / Complete 



Number 

Percent 


26 

93 % 


131 

95% 


157 

95% 




Unsuccessful / Incomplete 

Number 


2 


7 


9 




Percent 


7% 


5% 


5% 




Total Students 


28 


138 


166 





The Legal, Ethical, and Social Values of Business 

The results of a one-way ANOVA revealed there was a statistically significant difference (p < 
0.01) between final grades of Internet-based and campus-based students in The Legal, Ethical, 
and Social Values of Business that completed the course. Students in Internet-based sections had 
higher final grades than those in campus-based sections (means of 3.92 and 3.71, respectively). 
For a distribution of final grades for graduate students in Internet-based and campus-based 
sections of The Legal, Ethical, and Social Values of Business refer to Appendix A, Table 3a and 
Figure 2a. 

Success and Completion Rates 

Graduate students in Internet-based and campus-based sections of The Legal, Ethical, and Social 
Values of Business had comparable rates of success and completion (Figure 2). Ninety-two 
percent of graduate students in Internet-based sections and 94 percent of students in campus- 
based sections were successful and completed the course (Table 4). A Chi-square test revealed 
these differences were not statistically significant (p = 0.60). 
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Figure 2. Success and Completion Rates for Graduate Students in Internet-based versus 
Campus-based Sections of The Legal, Ethical, and Social Values of Business. 
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Table 2. Rates of Successful Grades and Completion for Graduate Students in Internet- 
based and Campus-based Sections of The Legal, Ethical, and Social Values of Business. 





Format 

Internet-based Campus-based 


Total 


Successful / Complete 








Number 


66 


118 


184 


Percent 


92% 


94% 


93% 



Unsuccessful / Incomplete 





Number 


6 


8 


14 




Percent 


8% 


6% 


7% 


Total Students 




72 


126 


198 
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Delivering Superior Customer Value 

The results of a one-way ANOVA revealed there was a statistically significant difference (p = 
0.06) between final grades of Internet-based and campus-based students in Delivering Superior 
Customer Value that completed the course. Students in campus-based sections had higher final 
grades than those in Internet-based sections (means of 3.6 and 3.56, respectively). For a 
distribution of final grades for graduate students in Internet-based and campus-based sections of 
Delivering Superior Customer Value refer to Appendix A, Table 4a and Figure 3a. 

Successful Grades 



Graduate students in Internet-based and campus-based sections of Delivering Superior Customer 
Value had comparable rates of success and completion (Figure 3). Ninety-five percent of 
graduate students in Internet-based sections and 94 percent of students in campus-based sections 
were successful (Table 4). A Chi-square test revealed there was not a statistically significant 
difference in successful grade rates (p = 0.92). 



Figure 3. Success and Completion Rates for Graduate Students in Internet-based versus 
Campus-based Sections of Delivering Superior Customer Value. 
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Table 3. Rate of Successful Grades for Graduate Students in Internet-based and Campus- 
based Sections of Delivering Superior Customer Value. 





Format 


Total 




Internet-based 


Campus-based 


Successful 








Number 


18 


80 


98 


Percent 


95% 


94% 


94% 



Unsuccessful 



Number 


1 


5 


6 


Percent 


5% 


6% 


6% 


Total Students 


19 


85 


104 



Completion Rates 

One hundred percent of graduate students in Internet-based sections and 94 percent of students in 
campus-based sections completed the course (Table 4). A Chi-square test revealed there was not 
a statistically significant difference in completion rates (p = 0.28). 



Table 4. Rate of Completion for Graduate Students in Internet-based and Campus-based 
Sections of Delivering Superior Customer Value. 



Format 




Internet-based Campus-based 


Total 



Complete 



Number 

Percent 


19 

100% 


80 

94% 


99 

95% 


Incomplete 








Number 


0 


5 


5 


Percent 


0% 


6% 


5 % 


Total Students 


19 


85 


104 
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DISCUSSION 



This study was undertaken to evaluate selected student outcomes of Internet-based distance 
education at Nova Southeastern University’s Wayne Huizenga Graduate School of Business and 
Entrepreneurship. Statistical analyses were computed comparing both Internet-based and 
campus-based sections of the same course offered in the Fall Term of 1999. The fundamental 
question was the following: 

Are there substantial differences between graduate student outcomes in specific Internet- 

based and campus-based courses offered in the Wayne Huizenga Graduate School of 

Business and Entrepreneurship? 

There were neither statistical nor practical differences in success or completion rates for students 
in Internet- and campus-based sections of Twenty-first Century Management, The Legal, Ethical, 
and Social Values of Business, and Delivering Superior Customer Value. For the three courses, 
success and completion rates of students in Internet- and campus-based sections only differed by 
two to six percent. 

The head counts of students for these three courses accounted for almost 50 percent of the total 
enrollment for courses taught in both modalities at the Wayne Huizenga Graduate School of 
Business and Entrepreneurship. Accordingly, the results of the present study suggest that the 
previous findings of higher rates of success and completion for students in internet-based 
sections were due to a general trend for all Internet- and campus-based courses of the Wayne 
Huizenga Graduate School of Business and Entrepreneurship and not due to student outcomes of 
specific courses. 

Previous research also revealed students of internet-based sections in the Wayne Huizenga 
Graduate School of Business and Entrepreneurship had statistically significantly higher final 
grades than those in campus-based sections. For the present study, a pattern of higher grades for 
those in Internet-based sections was not observed. Of the three courses, only student outcomes 
for The Legal, Ethical, and Social Values of Business supported this finding. Therefore, the 
previous finding of significantly higher final grades for those in Internet-based sections is also 
likely due to a general trend for all students of courses taught in both modalities in the Wayne 
Huizenga Graduate School of Business and Entrepreneurship. 

To further evaluate the effectiveness of Internet-based courses in the Wayne Huizenga Graduate 
School of Business and Entrepreneurship it is helpful to compare course completion rates for 
students in Internet-based courses with other institutions. According to Carr (2000), course 
completion rates for distance education based courses has been a concern for many institutions. 
Whereas Carr reported 10 to 20 percent higher course completion rates for students in traditional 
sections, at Nova Southeastern University there was no difference in course completion rates for 
the courses studied. 
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Appendix A 

Data for Internet-based versus Campus-based Sections 
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Table 2a. Grade Distribution for Internet-based and Campus-based Sections of Twenty-first Century Management. 



o 

CM 



a 

© 

H 



a 

jn 

55 



U 

U 



+ 

u 



CO 



CO 



+ 

P 9 



◄ 

◄ 



00 



s© 

o N 

O 

o 



N© 

© x 



N© 

o x 



n© 

o x 



S© 

o ^ 



N© 

o x 



N© 

O ^ 



o ° 



N© 

O''' 



N© 

<N ^ 



0 

E 

u 

fe 



T3 
u 
c n 
0 
pQ 

z 

<L> 

a 



<u 



s© 

o x 



V® 

o x 



N© 

o x 



a> 

oo 

0 

0 

a> 

B 

a> 



fe £ fi 



s© 

00 0 s 



m 



o 

o 



v© 

© x 



N© 

o ^ 



<N 



^ © 



v© 

o x 



O ° 



S© 

o x 

O 

N© 

er" 



<N 



N© 



N© 

o x 



N© 

o x 



S© 

OO ©^ 
VO 



N© 

r- ^ 



<N 



s© 
(N ©^ 

o 

m 



vo 






T 3 

<U 
tW 

0 ^ 

JO <D 

J, -S 

a s 

E * * 

Cl 

u 



a> 

se 

o 

a> 

B 

0> 



u 

0 

'M 

a 

o 

U 



IS 

* 

a 

a> 

£ 

H 



CA 

a 

o 

•« 

'M 

CJ 

o 

03 

T 3 

o 

CA 

0 

JO 

CA 

0 

a 

E 

0 

U 

0 >M 

E 3 

« 2 
E 

0 £ 

JO OX) 
4 L 0 

a> a 
a 0 

J 3 2 



Up 

0 

O 

• M 

0 

pO 



a> 

T 3 

0 

Up 

a 

U-l 

O 

<u 

OX) 

0 

+■> 

0 

O 

U 

Up 

O 

Pm 

0 



0 

OX) 





“D 


“D 


CD 


0 


CO 


c 0 


03 


03 


-Q 


_Q 


CO 


-4— ' 

CD 

C 

1 — 

CD 


3 

Q_ 

E 

03 


_C 


O 


a 


■ 





nP 

0 s 


so 

0^ 


sO 

0^ 


sO 

0^ 


v© 

0 s 


O 


O 


0 


0 


O 


CD 


in 




00 


CNJ 



AjoB 0 ;bq 10 d 6 e)Ud 0 Jdd 



o 



m 

1 

< 




05 



Table 3a. Grade Distribution for Internet-based and Campus-based Sections of The Legal, Ethical, and Social Values of 

Business. 
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